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( Recently, computational modelling became a very important research 

^\ ■ tool that enables us to study problems that for decades evaded scientific 

analysis. Evolutionary systems are certainly examples of such problems: 
^ , they are composed of many units that might reproduce, diffuse, mutate, 

I ■ die, or in some cases for example communicate. These processes might 

0O ' be of some adaptive value, they influence each other and occur on var- 

f*"^ , ious time scales. That is why such systems are so difficult to study. In 

this paper we briefly review some computational approaches, as well as 
our contributions, to the evolution of ecosystems and language. We start 
. from Lotka-Volterra equations and the modelling of simple two-species 

5_l ' prey-predator systems. Such systems are canonical example for study- 

ing oscillatory behaviour in competitive populations. Then we describe 
various approaches to study long-term evolution of multi-species ecosys- 
tems. We emphasize the need to use models that take into account both 
ecological and evolutionary processes. Recently we introduced a sim- 
ple model of this kind, and its behaviour is briefly summarized. In this 
multi-species prey-predator system, competition of predators for preys 
and space results in evolutionary cycling. We suggest that such a be- 
haviour of the model might correspond to long-term periodic changes of 
the biodiversity of the Earth ecosystem as predicted by Raup and Sep- 
koski. Finally, we address the problem of the emergence and develop- 
ment of language. It is becoming more and more evident that any theory 
of language origin and development must be consistent with darwinian 
principles of evolution. Consequently, a number of techniques developed 
for modelling evolution of complex ecosystems are being applied to the 
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problem of language. We briefly review some of these approaches. We 
also discuss the behaviour of a recently introduced evolutionary version 
of the naming-game model. In this model communicating agents reach 
linguistic coherence via a bio-linguistic transition which is due to the 
coupling of evolutionary and linguistic abilities of agents. 

1.1. Introduction 

Evolution is a fundamental property of life. It consists of two basic and in 
a sense opposing ingredients. Mutations and crossing-over are forces that 
increase variability of organisms and eventually lead to the formation of 
new brands and species. Against these processes acts selection and due 
to limited resources only best adapted organisms survive and pass their 
genetic material to the next generation. 

Evolutionary forces are operating since the very early emergence of life. 
To large extent they shaped the complicated pattern of past and present 
speciation and extinction processes. Even qualitative understanding of the 
dynamics that governs these processes is a very challenging problem. El- 
dredge and Gould 25 ' 95 noted that palaeontological data show that intensity 
of speciation and extinction processes varied throughout the life history 
and periods of evolutionary stagnation were interrupted with bursts of ac- 
tivity (punctuated equilibrium). Such a pattern, at least for a physicist, 
resembles the behaviour of a system at a critical point. Indeed, similarly 
to critical systems, some palaeontological data can be also described with 
power laws. 69 Following the work of Bak and Sneppen, 6 a lot of models that 
try to explain why an Earth ecosystem might be considered as a critical sys- 
tem, were examined. 69 But the quality of palaeontological data does not 
allow for definitive statements and some alternative interpretations were 
also proposed. In particular, an interesting conjecture was made by Raup 
and Sepkoski who suggested that the pattern of bursts of extinctions is 
actually periodic in time with a period of approximately 26 mln. years. 86 
Despite an intensive research it is not clear what a factor could induce such 
a periodicity, and certainly, it would be desirable to understand the main 
macroevolutionary characteristics of Earth's ecosystem. 

But it is not only intensity of extinction and speciation processes that is 
of some interest. In the evolution of life one can distinguish several radical 
changes that had a dramatic consequences and lead to the emergence of 
new levels of complexity 61 As examples of such changes Maynard-Smith 
and Szathmary list invention of genetic code, transition from Prokaryotes 
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to Eukaryotes, or appearance of colonies. Certainly, such changes had a 
tremendous impact on the evolution and the current state of the Earth's 
ecosystem. As a last major transition of this kind, Maynard-Smith and 
Szathmary mention the emergence of human societies and language. To 
large extent this transition was induced by cultural interactions. Such in- 
teractions when coupled to evolutionary processes lead to the immensely 
complex system - human society. According to Dawkins, 21 cultural inter- 
actions open a new route to the evolution that is no longer restricted to 
living forms. Examples of such forms, called memes, include songs (not 
only human), well known sentences and expressions, fashion or architec- 
ture styles. As a matter of fact, events listed as major transitions have 
an interesting feature in common - they created new mechanisms of infor- 
mation transmission. Language certainly enables transmission and storage 
of very complex cultural information. Its emergence enormously speeded 
up the information transfer between generations. Before that, for nearly 
four billion years of life on Earth, the only information that could be used 
for evolutionary purposes was encoded in the genome. With language vast 
amount of information can be exchanged between humans and passed on to 
subsequent generations. Most likely it was the invention of language that 
enormously speeded up the the evolution of our civilization and made hu- 
mans in a sense a unique species. Although the emergence and subsequent 
evolution of language had tremendous influence, this process is still to large 
extent mysterious and is considered as one of the most difficult problems 
in science. 17 

Computer modelling seems to be a very promising technique to study 
complex systems like ecosystems or langauge. In the present paper we 
briefly review such an approach and present our results in this field. In 
section 1.2 we briefly discuss population dynamics of simple two-species 
prey-predator systems and classical approaches in this field based on Lotka- 
Volterra equations. We also argue that it is desirable to use an alternative 
approach, the so-called individual based modelling. An example of such 
a model is described in section 1.3. In this section we discuss results of 
numerical simulations of the model concerning especially the oscillatory 
behaviour. 

Processes in simple ecosystems with constant number of non-cvolvable 
species (as described in section 1.2) take place on ecological time scale. 
To describe real, i.e., complex, ecosystems we have to take into account 
also evolutionary processes, such as speciations or extinctions. Such pro- 
cesses operate on the so-called evolutionary time scale. Such a time scale 
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was usually regarded as much longer than ecological time scale, however, 
there is a number of examples that show that they are comparable. 28 ' 107 
In section 1.4 we briefly review models used to study complex ecosystems. 
In particular, we emphasize the need to construct models that would take 
into account both ecological and evolutionary processes. In section 1.5 we 
examine one of such models which is a multi-species generalization of prey- 
predator model studied in section 1.3. Investigating extinction of species 
we show that their intensity changes periodically in time. The period of 
such oscillations is set by the mutation rate of the model. Since evolu- 
tionary changes are rather slow, we expect that such oscillations in the 
real ecosystem would have very long periodicity. We suggest that such a 
behaviour agrees with the conjecture of Raup and Sepkoski, but more de- 
tailed analysis of the predictions of our model would be desirable. In the 
final part of this section we suggest that our model might provide an in- 
sight into a much different problem. Namely, wc attempt to explain the 
uniqueness of the coding mechanism of living cells as contrasted with the 
multispecies structure of present-day ecosystems. Apparently, at the early 
stage of life a primitive replicator happened to invent the universal code 
that was so effective that it spread over the entire ecosystem. However, 
at a certain point such a single-species ecosystem become unstable and 
was replaced by a multi-species ecosystem. In our model, upon changing a 
control parameter, a similar transition (between single- and multi-species 
ecosystems) takes place and we argue that it might be analogous to the 
early-life transition. 

In section 1.6 we review computational studies on language evolution. 
An important class of models is based on the so-called naming game in- 
troduced by Steels. 101 Recently, we examined an evolutionary version of 
this model and showed that coupling of evolutionary and linguistic inter- 
actions leads to some interesting effects. 55 Namely, for sufficiently large 
intensity of linguistic interactions, there appears an evolutionary pressure 
that rapidly increases linguistic abilities and the model undergoes an abrupt 
bio-linguistic transition. In such a way communicating agents establish a 
common vocabulary and the model reaches the so-called linguistic coher- 
ence. Our model incorporates both learning and evolution. Interaction of 
these two factors, known as a Baldwin effect, 7 is recently intensively stud- 
ied also in the context of language evolution. 115 Discussion of the Baldwin 
effect and related properties in our model is also presented in Section 1.6. 
We conclude in Section 1.7. 
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1.2. Coarse-grained versus individual-based modelling of an 

ecosystem 

Population dynamics provides the basis of the modelling of the ecosystem. 
Pierre Verhulst, regarded as its founding father, noticed that due to the 
finite environmental capacity the unlimited growth of the population pre- 
dicted by the linear growth equation is unrealistic. Consequently, Verhulst 
proposed that the time evolution of the population should be described by 
the following equation 112 

dx 

— =kx(l-x/x M ) (1-1) 

where k is the growth rate, x is the size of the population, and xm is the en- 
vironmental capacity. Equation (1.1), that is called logistic equation, found 
numerous applications in demographic studies. However, to describe any 
realistic ecosystem one should consider more, possibly interacting, pop- 
ulations. A step in this direction was made by Lotka who examined a 
simple autocatalytic reaction model. 58 His work was followed by Volterra 
who wrote down essentially the same set of ordinary differential equations 
(ODE) studying the statistics of fish catches. 113 Lotka- Volterra equations 
for two interacting populations of preys (x) and predators (y) can be written 
as 

dx , . 

— = x{a x - a 2 y) 

^=y(-a 3 + ai x) (1.2) 

where a\, a 2 , (13, and 04 are some positive constants. Although cqs. (1.2) 
constitute the canonical model to study periodic oscillations in competitive 
systems, 66 they were also criticized on various grounds. For example their 
solution depends on the initial condition, and the very form of eqs. (1.2) 
is structurally unstable. It means that their small modification (with e.g., 
higher order terms like x 2 y) will typically destroy oscillatory behaviour. 
Although there are some ODE models where such a limit cycle behaviour 
is more stable, 60 an important feature of any realistic system is missing 
in cqs. (1.1) or (1.2). Namely, they neglect spatial heterogenities. The 
simplest way to take them into account would be to consider x and y 
as spatially dependent quantities and then to replace eqs. (1.1) or (1.2) 
with their partial differential analogs. After such a modification cq. (1.1) 
becomes the famous Fisher equation, that in the one-dimensional case has 



October 27, 2008 23:21 World Scientific Review Volume - 9in x 6in zbaszyn 



A. Lipowski and D. Lipowska 



the form 

dx eft x 

— =kx(l-x/x M )+D— (1.3) 

where I is the spatial coordinate, D is the diffusion constant and x — x(t, I) 
depends on t and I. Various extensions of (1.3), that are called sometime 
reaction-diffusion models, were also intensively studied in ecological con- 
texts. 40 - 66 

Although description in terms of partial differential equations takes into 
account some of spatial heterogenities, it is still based on the coarse-grained 
quantities like x(t, I) and that means that it is essentially of the mean-field 
nature. Moreover, kinetic coefficients (k, D, xm, ai , »2, 03, 04, • ■ •) that 
enter such equations are usually difficult to determine from ecological data. 
Similar problems appear in alternative approaches to spatially extended 
ecological models based on coupled-map lattices 36 or intcgrodifference equa- 
tions. 35 It is thus worth to pursue an alternative approach, the so-called 
individual based modelling, where to some extent stochastic rules, mimick- 
ing realistic processes like death, breeding or movement, are formulated at 
the level of individual organisms. Models of ecosystems formulated within 
such an approach are particularly suited for numerical computations and 
resemble some noncquilibrium statistical mechanics models. Such a simi- 
larity is very valuable since the behaviour of ecological systems can be put 
in a wider perspective. 



1.3. Lattice prey-predator models 

To simplify calculations individual-based models of prey-predator systems 
are usually formulated on a cartesian rf-dimensional lattice of the linear 
size N. One can define dynamics of such models in various ways, but to 
provide a detailed example we present rules used in some of our previous 
works. 49 ' 53 In our model on each site i of a lattice there is a four-state 
variable = 0, 1, 2, 3 which corresponds to the site being empty (ej = 0), 
occupied by a prey (e* = 1), occupied by a predator (e, = 2) or occupied 
by a prey and a predator (e, = 3). Its dynamics has one control parameter 
t (0 < r < 1) and is specified as follows: 

• Choose a site at random. 

• With the probability r update a prey at the chosen site, provided 
that there is one (i.e., e = 1 or 3); otherwise do nothing. Provided 
that at least one neighbor of the chosen site is not occupied by a 
prey (i.e., e = or 2), the prey (which is to be updated) produces 
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one offspring and places it on the empty neighboring site (if there 
are more empty sites, one of them is chosen randomly). Otherwise 
(i.e., when there is a prey on each neighboring site) the prey does 
not breed (due to overcrowding). 
• With the probability 1 — r update a predator at the chosen site, 
provided that there is one (i.e., e = 2 or 3). Provided that the 
chosen site is occupied by a predator but is not occupied by a prey 
(e = 2), the predator dies (of hunger). If there is a prey on that 
site (i.e., e = 3), the predator survives and consumes the prey from 
the site it occupies. If there is at least one neighboring site which 
is not occupied by a predator, the predator produces one offspring 
and places it on the empty site (chosen randomly when there are 
more such sites). 

As neighboring sites, i.e., sites where offsprings can be placed, we usually 
consider the nearest neighbours, but taking into account further neighbours 
does not change the results qualitatively. 47 To characterize the behaviour 
of the model let us introduce the densities of preys (x) and predators (y) 
defined as 



where summation is over all N d sites i and 5 is Kroneckers (^-function. Of 
the main interest are actually averages (x) and {y}, where averaging is over 
simulation time. 

From the above rules it follows that the model has two absorbing states 
(i.e., once the model enter such a state it remains trapped there for ever). 
The first one is filled with preys only (x = 1, y = 0) and the second 
one is empty (x = 0, y = 0). Simulations 47,49 ' 53 show that for large 
enough r, both populations coexist and the model is in the active phase 
(x > 0, y > 0). When the update rate of preys r decreases, their number 
becomes to small to support predators. For sufficiently small r predators 
die out and the model quickly reaches the absorbing state where it is filled 
with preys (the empty absorbing state has a negligible probability of being 
reached by the model dynamics). The phase transition between active and 
absorbing phase was observed at positive r for d = 1, 2 and 3. At least for 
d = 1 (linear chain) Monte Carlo simulations clearly show that the phase 
transition belongs to the directed percolation (DP) universality class 53 (see 




(1.4) 



Fig. 1.1). 
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Fig. 1.1. In the directed percolation problem a fraction of bonds on a lattice is perme- 
able (thick lines). From the top horizontal line water starts to flow downward through 
permeable bonds. Bonds that are reachable by water are shown with arrows. If at a cer- 
tain (horizontal) level there would be no water, there would be no water below that level 
(absorbing state). When concentration of permeable bonds exceeds a certain threshold 
value a cluster of permeable bonds that spans from top to bottom is formed. At the 
threshold value the model is critical. A lot of dynamical models with a single absorbing 
state belong to the directed percolation universality class 

Such a behaviour is not surprising. There are by now convincing nu- 
merical and analytical arguments that various models possessing a single 
absorbing state generically belong to the DP universality class. 37 Moreover, 
models with multiple, but asymmetric absorbing states (such as e.g., the 
model analysed in this section) also belong to this universality class (mod- 
els with multiple but symmetric absorbing states typically belong to some 
other universality classes, or undergo discontinuous phase transitions 52 ). 
However, studying the critical behaviour of models with absorbing-state 
phase transitions is not entirely straightforward. For finite systems (which 
is obviously the case in various simulational techniques) and close to the 
critical point, the model has a non- negligible probability of entering an ab- 
sorbing state even when control parameters are such that the infinite system 
would remain in the active phase. Such a behaviour sets a size-dependent 
timescale (i.e., the lifetime of the active state) that severely affects sim- 
ulations. A special technique, the so-called dynamical Monte Carlo, is 
needed to obtain precise estimation of critical exponents for models of this 
kind. 32 ' 37 

Of our main interest, however, is the oscillatory behaviour of the model. 
To examine it, we measured the variances of the densities x and y as well as 
their Fourier transforms. Simulations show that for d = 1 and d — 2 in the 
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limit N — > oo stochastic fluctuations wash out the oscillatory behaviour 
and the variances of densities vanish. However, for d — 3 in the active 
phase and close to the absorbing transition, there is a range of r where 
oscillatory behaviour survives in the limit N — ► oo. a Oscillations occur 
essentially for any initial conditions and their period only weakly depends 
on the parameter r. 

It is the dimension of the lattice d that most likely plays an important 
role. Indeed, simulations show that for d = 2 models but with larger 
number of neighbouring sites oscillations are again washed out in the limit 
N — > oo. 47 Such a result is in agreement with some arguments of Grinstein 
et al. 33 who related temporal periodic phases of noisy extended systems 
and smooth interfaces in growth models and concluded that oscillations 
might exist but only for d > d c = 2. The (r, d) phase diagram of our model 
is sketched in Fig. 1.2. 

To get an additional insight into the behaviour of the model we can 
write mean-field equations that describe the time evolution of the densities 
x and y. Simple arguments 49 lead to the following set of equations 



where w is the number of neighboring sites, as defined in the dynamical 
rules of the model (in most of our simulations neighbouring sites were near- 
est neighbours and in such a case w = 2d) . For example in the first equation 
of (1.5), the first term (rx(l — x w )) describes the growth rate of preys due 
to updating a site with prey (rx) that happen to have at least one empty 
neighbouring site ((1 — x w )). The second term ((1 — r)xy) describes the 
decrease rate of preys due to an update of a site that happened to be a 
predator and that is also occupied by a prey. However, predictions of ap- 
proximation (1.5) even qualitatively disagree with numerical simulations. 
In particular, in any dimension d the approximation (1.5) predicts that 
for any positive r there is no phase transition between active and absorb- 
ing phases. Moreover, within this approach there is no indication of the 
oscillatory phase, as observed in Monte Carlo simulations for d = 3. 

a Such a conclusion is based on the non-vanishing of variances of densities in this limit. 
Strictly speaking, based solely on such a behaviour, one cannot exclude that this is e.g., 
chaotic behaviour that sets in. However, a pronounced peak in the Fourier transform 
of the time-dependent densities strongly supports the oscillatory interpretation of the 
numerical data. 



dx 

~dt 

dy 

dt 



rx(l — x w ) — (1 — r)xy 



(1 - r)xy(l - y w ) - (1 - r)y(l - x) 



(1.5) 
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Fig. 1.2. The schematic phase diagram of the lattice prey- predator model. The phase 
transition separating preys-only and coexistence phases most likely belongs to the di- 
rected percolation universality class, 53 but in more general models other transitions are 
possible. 63 It is not clear what is the fate of the oscillatory phase in d > 3 case, since 
the mean-field equations (1.5) (that most likely correctly describe the model in large 
dimension) do not predict the oscillatory regime. 



In the approximation (1.5) the probability that a site is occupied by a 
prey and predator is given as xy. This is of course only an approximation, 
and a much better scheme is obtained where this probability is considered as 
yet another variable (z), whose evolution follows from the dynamical rules 
of the model. In such a way we arrive at the following set of equations 47 

^ = rx(l - x w ) - (1 - r)z 
dt x ) \ ) 

^ = (l-rWl-f)-(l-r)(y-z) 



dz 



rx{l - x w ){y -z) (1 - r)z(l + z - x - y)(l - y w ) 



-(1 



(1.6) 

r)zy w 



1 — x 1 — y 

In the first term of the third equation of Eqs. (1.6) x(l — x w ) gives the 
probability that the chosen site contains the prey and at least one of its 
neighbours docs not. The factor |5f gives the probability that the site 
chosen for reproduction of the prey is occupied by the predator only. The 
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set of equations (1.6) remains in a much better (than (1.5)) agreement with 
Monte Carlo simulations. In particular it predicts, oscillatory regime for 
w > 4. In Monte Carlo simulations of models on cartesian lattices (we made 
simulations only for d = 1,2,3) oscillations appear only in the d = 3 case 
(i.e., w — 6), and for d = 2 (i.e., w = 4) these were only quasi-oscillations 
with the amplitude that vanishes in the limit TV — > oo. 

It is interesting to ask what is the mechanism that triggers the emer- 
gence of finite-amplitude oscillations. Roscnfcld et al. suggested 64 ' 88 that 
oscillatory behaviour in another lattice prey-predator model is induced by 
some kind of percolation transition (see Fig. 1.3). However, precise mea- 
surements of cluster properties in our model has shown that although some 
percolation transitions are indeed close to the onset of oscillatory regime, 
they clearly do not overlap with this onset. 48 Another proposal relates 
oscillations with some kind of stochastic resonance. 49,84 Such a relation 
might be suggested by the mean-field approximation (1.5) that in fact de- 
scribes a quasi-oscillatory dynamical system. Stochastic fluctuations, that 
are present in the lattice model but are neglected in the mean-field de- 
scription, might be considered as a noise perturbing such a dynamical sys- 
tem. As shown by Gang et al. 29 due to stochastic resonance, in some 
low-dimensional autonomous dynamical systems noise might induce oscil- 
latory behaviour and one can expect that a similar scenario operates in 
lattice prey-predator systems. 

There are also other lattice prey-predator models were similar oscilla- 
tions were observed. 5,10 ' 59,78 ' 83,90 In a more general model, were predation 
and reproduction time scales are independent, a first-order phase transi- 
tion might appear. 63 One can also mention that there are some important 
ecological problem that so far were not examined with individual based 
modelling but where such an approach might prove to be valuable. In this 
context one can mention various synchronization problems in spatially ex- 
tended ecological systems 9 and in particular the Moran effect describing 
synchronization of populations exposed to common noise. 26 

1.4. Modelling of complex ecosystems 

Models that we discussed in the previous section describe rather simple 
ecosystems composed of few (two, three,...) species. Dynamics of such 
models implements basic ecological processes: reproduction, death, and in 
some cases also migration or aging. In such models changes of the popula- 
tions takes place on a characteristic ecological time scale that is set by the 
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Fig. 1.3. In the bond percolation problem a fraction c of bonds is occupied (thick 
lines). 92,93 Neighbouring occupied bonds form clusters. When c exceeds a certain 
threshold value an infinite (i.e., spanning the entire lattice) cluster is formed. In a 
related problem of site percolation a fraction of sites is occupied and neighbouring oc- 
cupied sites form clusters. As suggested by Rosenfeld et a/. 64,88 oscillatory behaviour 
might be induced by some kind of percolation transition i.e., formation of an infinite 
cluster of preys or predators. Although the idea is appealing some calculations do not 
support it. 48 



dynamics of the models Typically, in real ecosystems this scale is of the or- 
der of years (for example, in a hare-lynx system oscillations with the period 
of approximately 10 years were identified 91 ). But there are also some other 
than ecological processes. On the so-called evolutionary (or geological) time 
scale the entire species might die, change, or give rise to a new species. The 
evolutionary time scale is usually considered as much longer than ecolog- 
ical one. 30 As a result very often researchers constructed specific models 
directed toward either ecological or evolutionary processes. However, there 
are numerous examples showing that these time scales are not that much 
different and in some cases they are even comparable. 28 ' 107 Thus, such a 
separation of time scales is to some extent artificial and was used mainly for 
the ease of modelling (for a theoretical discussion of some related issues see 
e.g., the paper by Khibnik and Kondrashov 43 ). Actually, the complexity 
of real multi-species ecosystems and the difficulty to model them to some 
extent follow from the fact that these scales are not completely separated 
and ecological and evolutionary processes affect each other. 

A model of multi-species ecosystem that tries to describe evolutionary 
processes and drew considerable attention especially in physicists commu- 
nity was introduced by Bak and Sneppen 6 (see Fig. 1.4). An interesting 
property of this model is its self-organized criticality. Namely, dynamics 
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drives the model into the state where extinctions are strongly correlated 
(like in critical systems) and such a behaviour resembles the punctuated 
equilibrium hypothesis of Eldredge and Gould. 25 ' 95 However, the Bak- 
Sncppen model has the dynamics that is operating at the level of species 
and refers to the (still controversial) notion of fitness. Thus, the model 
neglects ecological effects and despite rich and intriguing dynamics can be 
considered only as a toy model of an ecosystem. Nevertheless, the work 
of Bak and Sneppen inspired other researchers to examine a number of 
models with species-level dynamics. For example, Vandevalle and Ausloos 
incorporated speciation, 110 Sole and Manrubia introduced various interac- 
tions between species, 98 and Amaral and Meyer considered some elements 
of the food-chain dynamics. 4 Although these models drastically simplify 
the dynamics of real ecosystems they do provide a valuable qualitative de- 
scription of some complex problems such as formation of trophic levels or 
correl 



Bak-Sneppen model 



extinction 



species 



species 



Fig. 1.4. The one-dimensional version of the Bak-Sneppen model. First, the species 
of lowest fitness is selected. Then this species and two of its neighbours (denoted by 
crosses) go extinct and are replaced by three new species with randomly selected fitness. 
Such a simple dynamics (no control parameters) drives the model into the critical state. 
The extremal dynamics of the Bak-Sneppen model was criticized on biological grounds, 
nevertheless this model drew considerable attention and is one of the main models of the 
self-organized criticality. 

Recently, computational methods made feasible the analysis of models 
that incorporate both ecology and evolution. One way to construct such 
models is to generalize Lotka-Volterra equations to the multi-species case 
and to implement some speciation and extinction mechanism. Such an 
approach has already been developed, 2 ' 12 ' 18 but it has similar drawbacks 
as original Lotka-Volterra model, namely it neglects spatial heterogeneities. 
In an alternative approach one uses individual-based dynamics and some 
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models of multi-species ecosystems equipped with such a dynamics were 
examined. 15 A diagram that illustrates some types of models and their 
range of applicability is shown in Fig. 1.5. 
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Fig. 1.5. Ecological and evolutionary aspects of the modelling of an ecosystem. The 
most coarse-grained models of ecosystem have dynamics operating at the level of species. 
Such models (e.g., Bak-Sneppen, 6 Food-web models 4 ) neglect population level processes 
and describe ecosystem at the evolutionary time scale. Models originating from the 
Lotka-Volterra model use dynamics defined at the population level. Such models describe 
ecological processes in few-species ecosystems, but multi-species versions of Abramson, 2 
Caldarelli ct al. 12 or Coppex et al., 18 that encompass also the evolutionary process 
were examined as well. Similar range of applicability have models with individual level 
dynamics (the model of Chowdhury et al. 15 neglects, however, the heterogeneities in 
spatial distribution of organisms). 



1.5. Multispecies prey-predator model and periodicity of ex- 
tinctions 

In this section we describe the multi-species version of a lattice prey- 
predator model. 51 ' 54 Numerical simulations of the model show that the 
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periodicity of mass extinctions, that was suggested by Raup and Sepkoski, 86 
might be a natural feature of the ecosystem's dynamics and not the result 
of a periodic external perturbation. 



1.5.1. Model 

Our model might be considered as a generalization of the two-species model 
described in section 1.3. The model is defined on a <i-dimensional cartesian 
lattice of the linear size N. Similarly to the two-species model one uses the 
four-state variables ej = 0, 1,2 or 3. In addition, each predator is charac- 
terized by its size m (0 < m < 1) that determines its consumption rate and 
at the same time its strength when it competes with other predators. Only 
approximately the size m can be considered as related with physical size. 
Predators and preys evolve according to rules typical to such systems (e.g., 
predators must eat preys to survive, preys and predators can breed provided 
that there is an empty site nearby, etc.). In addition, the relative update 
rate for preys and predators is specified by the parameter r (0 < r < 1) 
and during breeding mutations are taking place with the probability p mut . 
More detailed definition of the model dynamics is given below: 

• Choose a site at random (the chosen site is denoted by i). 

• Provided that i is occupied by a prey (i.e., if e$ = 1 or ej = 3) 
update the prey with the probability r. If at least one neighbor 
(say j) of the chosen site is not occupied by a prey (i.e., ej = or 
Cj = 2), the prey at the site i produces an offspring and places it 
on an empty neighboring site (if there are more empty sites, one of 
them is chosen randomly). Otherwise (i.e., if there are no empty 
sites) the prey does not breed. 

• Provided that i is occupied by a predator (i.e., ej = 2 or ej = 3) 
update the predator with the probability (1 — r)mj, where rrii is the 
size of the predator at site i. If the chosen site i is occupied by a 
predator only (ej = 2), it dies, i.e., the site becomes empty (ej = 0). 
If there is also a prey there (ej = 3), the predator consumes the 
prey (i.e., ej is set to 2) and if possible, it places an offspring at an 
empty neighboring site. For a predator of the size m; it is possible 
to place an offspring at the site j provided that j is not occupied by 
a predator (ej = or e 3 ■ = 1) or is occupied by a predator (ej = 2 
or ej = 3) but of a smaller size than mj (in such a case the smaller- 
size predator is replaced by an offspring of the larger-size predator). 
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The offspring inherits its parent's size with the probability 1 —p mu t 
and with the probability p m ut it gets a new size that is drawn from 
a uniform distribution. 

At first sight one can think that such a model describes an ecosystem 
with two trophic levels (preys and predators) and only with predators be- 
ing equipped with evolutionary abilities, which would be of course highly 
unrealistic. Let us notice, however, that expansion of predators sometimes 
proceeds at the expense of smaller-size predators. Thus, predators them- 
selves are involved in prey-predator-like interactions. Perhaps it would be 
more appropriate to consider unmutable preys as a renewable (at a finite 
rate) source of, e.g., energy, and predators as actual species involved in var- 
ious prey-predator interactions and equipped with evolutionary abilities. 

In the remaining part of this section we will describe a possible appli- 
cation of our model to the problem of mass extinctions and to the problem 
of multiplicity of species in the Earth ecosystem as contrasted with the 
uniqueness of the genetic code. 



1.5.2. Extinctions 

The suggestion that mass extinctions might be periodic in time was made 
by Raup and Sepkoski. 86 While analyzing fossil data, they noticed that 
during the last 250 My (million years) mass extinctions on Earth appeared 
more or less cyclically with a period of approximately 26My. Although their 
analysis was initially questioned, 77 some other works confirmed Raup and 
Sepkoski's hypothesis. 27,81 ' 82 The suggested large periodicity of mass ex- 
tinctions turned out to be very difficult to explain. Indeed, 26My does not 
seem to match any of known Earth cycles and some researchers have been 
looking for more exotic explanations involving astronomical effects, 20,85 in- 
creased volcanic activity, 104 or the Earth's magnetic field reversal. 103 So 
far, however, none of these proposals has been confirmed. One should also 
note that the most recent analysis of palaeontological data that span last 
542My strongly supports the periodicity of mass extinctions albeit with a 
larger cycle of about 62My. 87 

Lacking a firm evidence of an exogenous cause, one can ask whether 
the periodicity of extinctions might be explained without referring to such 
a factor. In sections 1.2 and 1.3 we already mentioned that periodic be- 
haviour of some prey-predator systems is not the result of periodic driving 
but rather a natural feature of their dynamics. However, the period of 
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oscillations in such systems is determined by the growth and death rate 
coefficients of interacting species and is of the order of a few years rather 
than tens of millions. Consequently, if the periodicity of mass extinctions is 
to be explained within a model of interacting species, a different mechanism 
that generates long-period oscillations must be at work. 

Such a mechanism might be at work in the multi-species model de- 
scribed in section 1.5.1. Numerical simulations 51,54 show that the model 
generates long-period evolutionary oscillations The period of these oscilla- 
tions is determined by the inverse of the mutation rate and we argued that 
it should be several orders of magnitude longer than in the Lotka-Volterra 
oscillations. The mechanism that generates oscillations in our model can 
be briefly described as follows: A coevolution of predator species induced 
by the competition for food and space causes a gradual increase of their 
size. However, such an increase leads to the overpopulation of large preda- 
tors and a shortage of preys. It is then followed by a depletion of large 
species and a subsequent return to the multi- species stage with mainly 
small species that again gradually increase their size and the cycle repeats. 
Numerical calculations for our model show that the longevity of a species 
depends on the evolutionary stage at which the species is created. A simi- 
lar pattern has been observed in some palaeontological data 62 and, to our 
knowledge, the presented model is the first one that reproduces such a de- 
pendence. Let us notice that the oscillatory behaviour in a prey-predator 
system that was also attributed to the coevolution has been already exam- 
ined by Dieckmann ct al. 24 In their model, however, the number of species is 
kept constant and it cannot be applied to study extinctions. Moreover, the 
idea that an internal ecosystem dynamics might be partially responsible for 
the long-term periodicity in the fossil records was suggested by Stanley 100 
and later examined by Plotnick and McKinney. 80 However, according to 
Stanley mass extinctions are triggered by external impacts. Their approx- 
imately equidistant separation is the result of a delayed recovery of the 
ecosystem. In our approach no external factor is needed to trigger such 
extinctions and sustain their approximate periodicity. 

A gradual increase of size of species in our model recalls the Cope's 
rule that states that species tend to increase body size over geological time. 
This rule is not commonly accepted among paleontologists and evolutionists 
and was questioned on various grounds." However, recent studies of fossil 
records of mammal species are consistent with this rule. 3,111 Perhaps our 
model could suggests a way to obtain a theoretical justification of this rule. 

Although very complicated, in principle, it should be possible to es- 
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timate the value of the mutation probability p mu t from the mutational 
properties of living species. Let us notice that in our model mutations 
produce an individual that might be substantially different from its par- 
ent. In Nature, this is typically the result of many cumulative mutations 
and thus we expect that p mu t is indeed a very small quantity. Actually 
Pmut should be considered rather as a parameter related with the speed of 
morphological and speciation processes that are known to be typically very 
slow. 30 Perhaps a different version of the mutation mechanism where a 
new species would be only a small modification of its parental species could 
be more suitable for comparison with living species, but it might require 
longer calculations. 



1.5.3. Unique genetic code and the emergence of a multi- 
species ecosystem 

All living cells use the same code that is responsible for the transcription of 
information from DNA to proteins. 75 ' 106 It suggests that at a certain point 
of evolution of life on Earth a replicator that invented this apparently effec- 
tive mechanism was able to eliminate replicators of all other species (if they 
existed) and establish, at least for a short time, a single-species ecosystem. 
Although this process is still to a large extent mysterious, one expects that 
subsequent evolution of these successful replicators leads to their differenti- 
ation and proliferation of species. In such a way the ecosystem shifted from 
a single- to multi-species one. 50 It seems to us that our model might provide 
some insight into this problem. Numerical simulations show 51 ' 54 that the 
oscillatory behaviour appears in our model only for the relative update rate 
r < 0.27. When preys reproduce faster (r > 0.27), a different behaviour 
can be seen and the model reaches a steady state with almost all predators 
belonging to the same species with the size m close to 1. Only from time 
to time a new species is created with even larger m and a change of the 
dominant species might take place. In our opinion, it is possible that at 
the very early period of evolution of life on Earth, the ecosystem resembled 
the case r > 0.27. This is because at that time substrates ('preys') were 
renewable faster than primitive replicators ('predators') could use them. If 
so, every invention of the increase of the efficiency ('size') could invade the 
entire system. In particular, the invention of the coding mechanism could 
spread over the entire system. A further evolution increased the efficiency of 
predators and that effectively shifted the (single-species) ecosystem toward 
the r < 0.27 (multi-species, oscillatory) regime. 
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1.5.4. Multispecies prey-predator model - summary and per- 
spectives 

In this section we discussed a model where densities of preys and predators 
as well as the number of species show long-term oscillations, even though 
the dynamics of the model is not exposed to any external periodic forcing. 
It suggests that the oscillatory behaviour of the Earth ecosystem predicted 
by Raup and Sepkoski could be simply a natural feature of its dynamics 
and not the result of an external factor. Some predictions of our model 
such as the lifetime of species or the time dependence of their popula- 
tion sizes might be testable against palaeontological data. Certainly, our 
model is based on some restrictive assumptions that drastically simplify 
the complexity of the real ecosystem. Nevertheless, it includes some of its 
important ingredients: replication, mutation, and competition for resources 
(food and space). As an outcome, the model shows that typically there is 
no equilibrium-like solution and the ecosystem remains in an evolutionary 
cycle. The model does not include geographical barriers but let us notice 
that palaeontological data that suggest the periodicity of mass extinctions 
are based only on marine fossils. 87 More realistic versions should take into 
account additional trophic levels, gradual mutations, or sexual reproduc- 
tion. One should also notice that the palaeontological data are mainly at a 
genus, and not species level. It would be desirable to check whether the be- 
haviour of our model is in some sense generic or it is merely a consequence 
of its specific assumptions. An interesting possibility in this respect could 
be to recast our model in terms of Lotka-Volterra like equations and use 
the methodology of adaptive dynamics developed by Dieckmann ct al. 24 
Of course, the real ecosystem was and is exposed to a number of external 
factors such impacts of astronomical objects, volcanism or climate changes. 
Certainly, they affect the dynamics of an ecosystem and contribute to the 
stochasticity of fossil data. Filtering out these factors and checking whether 
the main evolutionary rhythm is indeed set by the ecosystem itself, as sug- 
gested in the present paper, is certainly a difficult task but maybe worth 
an effort. 



1.6. Computational approaches to the evolution of language 

In this section we describe computational approaches to the problem of 
evolution of language. In this field the mainstream research takes the dar- 
winian standpoint: natural selection guided the language development and 
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emergence of its basic features. One thus accept that at least some features 
of language have certain adaptive value and their gradual development is 
much more plausible than a catastrophic change. There are, however, some 
issues that still remain unclear within such a darwinian approach. For 
example evolutionary development of a reliable communication system re- 
quires a substantial amount of altruism and it is not clear whether standard 
explanations that refer to kin selection or reciprocal altruism are applica- 
ble (for example kin selection does not explain our willingness to talk to 
non-kin) . Another problem is concerned with the interaction of evolution 
and learning, sometimes known as a Baldwin effect. In some cases, learn- 
ing is known to direct the evolutionary changes, and perhaps in such a 
way humans developed a language-specific adaptations commonly termed 
Language Acquisition Device (LAD). Efficiency of the Baldwin effect and 
even the very existence of LAD remain, however, open problems. There is 
perhaps a little chance that computational modelling will definitely resolve 
these issues. But already at the level of constructing appropriate models 
one has to quantify relevant processes and effects, and even that can provide 
a valuable insight. 



1.6.1. Evolution and language development 

The ability to use language distinguishes humans from all other species. 
Certain species also developed some communication modes but of much 
smaller capabilities as well as complexity. Since several decades various 
schools are trying to explain the emergence and development of language. 
Nativists argue that langauge capacity is a collection of domain-specific 
cognitive skills that are somehow encoded in our genome. However, the 
idea of the existence of such a Language Acquisition Device or " language or- 
gan" (the term coined by their most prominent representative Noam Chom- 
sky ), was challenged by empiricists, who argue that linguistic performance 
of humans can be explained using domain-general learning techniques. The 
recent critique along this line was made by Sampson, 89 who questions even 
the most appealing argument of nativists, that refer to the poverty of stim- 
ulus and apparently fast learning of grammar by children. An important 
issue of possible adaptative merits of language does not seem to be set- 
tled either. Non-adaptationists, again with Chomsky as the most famous 
representative, 14 consider language as a side effect of other skills and thus 
claim that its evolution, at least at the beginning, was not related with any 
fitness advantage. A chief argument against the non-adaptationist stand is 
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the observation that there is a number of costly adaptations that seem to 
support human linguistic abilities such as a large brain, a longer infancy 
period or descended larynx. Recently, in their influential paper, Pinker and 
Bloom argued that, similarly to other complex adaptations, language evo- 
lution can only be explained by means of natural selection mechanisms. 79 
Their paper triggered a number of works where language was examined 
from the perspective of evolutionary biology or game theory. 42,46 In partic- 
ular, Nowak et al. used some optimization arguments, that might explain 
the origin of some linguistic universals. 71 ' 72 They suggest that words ap- 
peared in order to increase the expressive capacity and sentences (made 
of words) limit memory requirements. Confrontation of nativists with em- 
piricists and adaptationists with non-adaptationists so far does not seem 
to lead to consensus but certainly deepened our understanding of these 
problems. 97 

Recently, a lot of works on the language emergence seem to have an 
evolutionary flavour. Such an approach puts some constraints on possible 
theories of the language origin. In particular, it rules out non-adaptationist 
theories, where language is a mere by-product of having a large and complex 
brain. 31 The emergence of language has been also listed as one of the major 
transitions in the evolution of life on Earth. 61 An interesting question is 
whether this transition was variation or selection limited. 105 In variation 
limited transitions the required configuration of genes is highly unlikely 
and it takes a considerable amount of time for the nature to invent it. For 
selection limited transitions the required configuration is easy to invent but 
there is no (or only very weak) evolutionary pressure that would favour it. 
Relatively large cognitive capacities of primates and their genetic proximity 
with humans suggests that some other species could have been also capable 
to develop language- like communication. Since they did not, it was perhaps 
due to a weak selective pressure. Such indirect arguments suggest that the 
emergence of language was selection limited. 105 

Some interesting results can be obtained by applying game-theory rea- 
soning to one of the most basic problems of emerging linguistic communi- 
cation, namely why do we talk (at all!) and why do we exchange valuable 
and trustful information. Since speaking is costly (it takes time, energy 
and sometimes might expose a speaker to predators), and listening is not, 
such a situation seems to favour selfish individuals that would only listen 
but would not speak. Moreover, in the case of the conflict of interests 
the emerging communication system would be prone to misinformation or 
lying. The resolution of these dilemmas usually refers to the kin selec- 
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tion 34 or reciprocal altruism. 108 In other words, speakers remain honest 
because they are helping their relatives or they expect that others will do 
the same for them in the future. As an alternative explanation Dessalles 23 
suggests that honest information is given freely because it is profitable - it 
is a way of competing for status within a group. Computational modelling 
of Hurford 41 gives further evidence that speaking might be more profitable 
than listening. Hurford considered agents engaged in communicative tasks 
(one speaker and one hearer) and their abilities evolved with the genetic 
algorithm that was set to prefer either communicative or interpretative suc- 
cess. Only in the former case the emerging language was similar to natural 
languages were synonymy was rare and homonymy tolerated. When in- 
terpretative success was used as the basis of selection then the converse 
situation (unknown in natural language) arose: homonymy was rare and 
synonymy tolerated. Some related results on computational modelling of 
the honest cost-free communication are reported by Noble. 70 

A necessary ingredient of language communication is learning. It is 
thus legitimate to ask whether darwinian selection might be responsible 
for the genetic hard-wiring of a Language Acquisition Device. Indeed, this 
(to some extent hypothetical) organ is most likely responsible for some of 
the arbitrary (as opposed to the functional) linguistic structures. But for 
such an organ to be of any value, an individual first has to acquire the 
language. The inheritance of characteristics acquired during an individual 
lifetime is usually associated with discredited lamarckian mechanism and 
thus considered to be suspicious. However, the relation between evolution 
and learning is more delicate and the attempts to clarify the mutual inter- 
actions of these two adaptive mechanisms have a long history. According 
to a purely darwinian explanation, known as a Baldwin effect 7,96 ' 114 , there 
might appear a selective pressure in a population for the evolution of the 
instinctive behaviour that would replace the beneficial, but costly, learned 
behaviour. 109 Baldwin effect presumably played an important role in the 
emergence and evolution of language but certain aspects of these processes 
still remain unresolved. 115 For example, one of the assumptions that is 
needed for the Baldwin effect to be effective is a relatively stable environ- 
ment since otherwise rather slow evolutionary processes will not catch up 
with the fast changing environment. Since the language formation processes 
are rather fast (in comparison to the evolutionary time scale) , Christiansen 
and Chater questioned the role of adaptive evolutionary processes in the 
formation of arbitrary structures like Language Acquisition Device. 16 Ac- 
tually, they suggest a much different scenario, where it is a language that 
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adapted to human brain structures rather than vice versa. 

1.6.2. Language as a complex adapting system 

From the above description it is clear that studying of the emergence and 
evolution of language is a complex and multidisciplinary task and requires 
cooperation of not only linguists, neuroscientists, and anthropologists, but 
also experts in artificial intelligence, computer sciences or evolutionary bi- 
ology. 73 One can distinguish two levels at which language can be studied 
and described 22 (Fig. 1.6). At the individual level the description centers 
on the individual language users: their linguistic performance, language ac- 
quisition, speech errors, speech pathologies or brain functioning in relation 
with language processing. At the individual level the language of each in- 
dividual is slightly different. Nevertheless, within certain population these 
individuals can efficiently communicate and that establishes the population 
level. At this level the language is considered as an abstract system that 
exists in a sense separately from the individuals users. There are numerous 
interactions between these two levels. Indeed, the linguistic behaviour of 
individuals depends on the language (at the population level) specific to 
the population they are part of. And, as a feedback, the language used in a 
given population is a collective behaviour and emerges from linguistic be- 
haviour of individuals composing this population. Various processes shap- 
ing such a complex system are operating at different time scales. The fastest 
dynamics is operating at the individual level (ontogenetic timescale 44 ) that 
includes, for example, language acquisition processes. Much slower pro- 
cesses, such as migrations of language populations, dialects formation or 
language extinctions, are operating at the so-called glossogenetic timescale. 
The slowest processes govern the biological evolution of language users and 
that defines the phylogcnetic timescale. Processes operating at these dif- 
ferent timescales are not independent (Fig. 1.6). Biological evolution might 
change linguistic performance of individuals and that might affect the glos- 
sogenetic processes. For example, a mutation that changes the vocal ability 
of a certain individual, if spread in his/her population, might lead to a di- 
alect formation or a language extinction. Such population-level processes 
might change the selective pressure that individual language users are ex- 
posed to and that might affect phylogenetic processes, closing thus the 
interaction loop. 

Various levels of descriptions and processes operating at several 
timescales suggest that complex models must be used to describe adequately 
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the language evolution. Correspondingly, the analysis of such models and 
predicting their behaviour also seem to be difficult. It is known that some 
phenomena containing feedback interactions might be described in terms 
of nonlinear differential equations, such as for example already described 
Lotka-Volterra equations. The behaviour of such nonlinear equations is of- 
ten difficult to predict, since abrupt changes even of the qualitative nature 
of solutions might take place. Language evolution is, however, much more 
complex than ecological problems of interacting populations and its descrip- 
tion in terms of differential equations would be much more complicated if at 
all feasible. It seems that recently the most promising and frequently used 
approach to examine such systems is computational modelling of multi- 
agent systems. Using this method one examines a language that emerges 
in a bottom-up fashion as a result of interactions within a group of agents 
equipped with some linguistic functions. Then one considers language as a 
complex adaptive system that evolves and complexifies according to biolog- 
ically inspired principles such as selection and self-organization. 102 Thus, 
the emerging language is not static but evolves in a way that hopefully is 
similar to human language evolution. Of course, using such an approach 
one cannot explain all intricacies of human languages. A more modest goal 
would be to understand some rather basic features that are common to all 
languages such as meaning-form mappings, origin of linguistic coherence 
(among agents without central control and global view), or coevolutionary 
origin of grammar and meaning. 

Within such a multi-agent approach, two groups of models can be dis- 
tinguished. In the first one, originating from the so-called iterated learning 
model, one is mainly concerned with the transmission of language between 
successive generations of agents. 11 ' 45 Agents that are classified as teach- 
ers produce some expressions that are passed to learners that try to infer 
their meaning using statistical learning techniques such as neural networks. 
After a certain number of iterations teachers are replaced by learners and 
a new population of learners is introduced. The important issue that the 
iterated learning model has successfully addressed is the transition from 
holistic (complex meaning expressed by a single form) to compositional 
language (composite meaning is expressed with composite form). However, 
since such a procedure is computationally relatively demanding and the 
number of communicating agents is thus typically very small, the problem 
of the emergence of linguistic coherence must be neglected in this approach. 
To tackle this problem Steels introduced a naming game model 101 . In this 
approach one examines a population of agents trying to establish a common 
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Fig. 1.6. Language as a complex adaptive system. Many different processes governing 
the language evolution are entangled at various levels. Relatively fast individual level 
(ontogenetics), comprising e.g., langaugc acquisition processes, is determined mainly 
by interactions between individual language users. Much slower are populational-lcvcl 
processes (glossogenetics) such as language formations, extinctions, grammar changes 
or migrations. To obtain a complete description one has to consider also biological 
evolution (phylogcnetics) and these are the slowest processes of the language evolution. 
Various processes at individual and population level affect the fitness landscape and 
that influences the biological evolution level. Similarly, individual language user level is 
affected by populational level processes. 

vocabulary for a certain number of objects present in their environment. 
The change of generations is not required in the naming game model since 
the emergence of a common vocabulary is a consequence of the communi- 
cation processes between agents, and agents are not divided into teachers 
and learners but take these roles in turn. 

1.6.3. Evolutionary naming game 

It seems that the iterated learning model and the naming-game model are at 
two extremes: the first one emphasizes the generational turnover while the 
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latter concentrates on the single-generation (cultural) interactions. Since in 
the language evolution both aspects are present, it is desirable to examine 
models that combine evolutionary and cultural processes. Recently we have 
introduced such a model 55 ' 56 and below we briefly describe it properties. 

In our model we consider a set of agents located at sites of the square 
lattice of the linear size N. Agents are trying to establish a common vocab- 
ulary on a single object present in their environment. An assumption that 
agents communicate only on a single object does not seem to restrict the 
generality of our considerations and has already been used in some other 
studies of naming game 8,19 or language-change 67 ' 68 models. A randomly 
selected agent takes the role of a speaker that communicates a word cho- 
sen from its inventory to a hearer that is randomly selected among nearest 
neighbours of the speaker. The hearer tries to recognize the communicated 
word, namely it checks whether it has the word in its inventory. A positive 
or negative result translates into communicative success or failure, respec- 
tively. In some versions of the naming game model 8 ' 19 a success means that 
both agents retain in their inventories only the chosen word, while in the 
case of failure the hearer adds the communicated word to its inventory. 

To implement the learning ability we have modified this rule and as- 
signed weights Wi (wi > 0) to each i-th word in the inventory. The speaker 
selects then the i-th word with the probability Wi / Wj where summa- 
tion is over all words in its inventory (if its inventory is empty, it creates 
a word randomly). If the hearer has the word in its inventory, it is recog- 
nized. In addition, each agent k is characterized by its learning ability Ik 
(0 < Ik < 1), that is used to modify weights. Namely, in the case of success 
both speaker and hearer increase the weights of the communicated word 
by their learning abilities, respectively. In the case of failure the speaker 
subtracts its learning ability from the weight of the communicated word. 
If after such a subtraction a weight becomes negative, the corresponding 
word is removed from the repository. The hearer in the case of failure, i.e., 
when it does not have the word in its inventory, adds the communicated 
word to its inventory with a unit weight. 

Apart from communication, agents in our model evolve according to 
the population dynamics: they can reproduce, mutate, and eventually die. 
To specify intensity of these processes we have introduced the communi- 
cation probability p. With the probability p the chosen agent becomes a 
speaker and with the probability 1-pa population update is attempted. 
During such a move the agent dies with the probability 1 — p surv , where 
Psurv = exp(— at)[l — cxp(— bJ2j w j/i w ))]> an d a ~ 0.05 and b = 5 are 
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certain parameters whose role is to ensure a certain speed of population 
turnover. Moreover, t is the age of an agent and (w) is the average (over 
agents) sum of weights. Such a formula takes into account both its lin- 
guistic performance (the bigger ^2- Wj the larger p surv ) and its age. If the 
agent survives (it happens with the probability p SU rv), it breeds, provided 
that there is an empty site among its neighbouring sites. The offspring 
typically inherits parent's learning ability and the word from its inventory 
that has the highest weight. In the offspring's inventory the weight as- 
signed initially to this word equals one. With the small probability p mu t 
a mutation takes place and the learning ability of an offspring is selected 
randomly anew. With the same probability an independent check is made 
whether to mutate the inherited word. Numerical simulations show that 
the described below behaviour of our model is to some extent robust with 
respect to some modifications of its rules. For example, qualitatively the 
same behaviour is observed for modified parameters a and b, different form 
of the survival probability p surv (provided it is a decreasing function of t 
and an increasing function of J2jWj), or different breeding and/or muta- 
tion rules. To examine the behaviour of the model we have measured the 
communication success rate s defined as an average over agents and simu- 
lation time of the fraction of successes with respect to all communication 
attempts. Moreover, we have measured the average learning ability I. 

Our model captures all three basic aspects of language: learning, cul- 
ture, and evolution. Agents in our model are equipped with an evolutionary 
trait: learning ability. When communication between agents is sufficiently 
frequent (i.e., when p is large enough), cultural processes create a niche in 
which a larger learning ability becomes advantageous. It causes an increase 
of learning ability, but its large value in turn makes the cultural processes 
more efficient. As a result the model was shown to undergo an abrupt bio- 
linguistic transition where both linguistic performance (s) and ability (I) 
of agents change very rapidly (see Figs. 1.7-1. 8). 55 It was also shown that 
under the plausible assumption, that the intensity of communication in- 
creases continuously in time, this bio-linguistic transition is replaced with 
a series of fast, transition-like changes. 56 In our opinion, the proposed 
model shows that linguistic and biological processes have a strong influence 
on each other, which has certainly contributed to an explosive development 
of our species. 
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Fig. 1.7. Exemplary configurations of the evolutionary naming game model 55,56 with 
L = 60 and p m ut = 0.001. In the small-p phase (upper panel) communications are 
infrequent and agents using the same language (left)or having the same learning abilities 
(right) form only small clusters. In this phase the communication success rate s and 
the learning ability I are small (see also Fig. 1.8). The larger the learning ability of 
an agent the darker are pixels representing it (white: 1=0; black: 1=1). In the largc-p 
phase (lower panel) frequent communications result in the emergence of the common 
language. Moreover, almost all agents use the same language and have the same, and 
large, learning ability. 

1.6.4. Baldwin effect 

That learning in our model modifies the fitness landscape of a given agent 
and facilitates the genetic accommodation of learning ability is actually 
a manifestation of the much debated Baldwin effect. The fact that the 
success rate s and the learning ability / have a jump at the same value of p 
shows that communicative and biological ingredients in our model strongly 
influence each other and that leads to the single and abrupt transition. In 
our model successful communication requires learning. A new-born agent 
communicating with some mature agents who already worked out a certain 
(common in this group) language will increase the weight of a corresponding 
word. As a result, in its future communications the agent will use mainly 
this word. In what way such a learning might get coupled with evolutionary 
traits? The explanation of this phenomenon is known as a Baldwin effect. 
Although at first sight it looks like a discredited Lamarckian phenomenon, 
the Baldwin effect is actually purely Darwinian. 38 ' 115 There are usually 
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Fig. 1.8. The success rate s and the learning ability I as a function of the communication 
probability p. Calculations were made for system size L = 60 and mutation probability 
Pmut = 0.001. Simulation time for each value of p was typically equal to 10 5 steps with 
3 • 10 4 steps discarded for relaxation. A step is defined as a single, on average, update 
of each site. 



some benefits related with the task a given species has to learn and there is a 
cost of learning this task. One can argue that in such case there is some kind 
of an evolutionary pressure that favours individuals for which the benefit is 
larger or the cost is smaller. Then, the evolution will lead to the formation 
of species where the learned behaviour becomes an innate ability. It should 
be emphasized that the acquired characteristics are not inherited. What is 
inherited is the ability to acquire the characteristics (the ability to learn). 109 
In the context of the language evolution the importance of the Baldwin 
effect was suggested by Pinker and Bloom. 79 Perhaps this effect is also at 
least partially responsible for the formation of the Language Acquisition 
Device. However, many details concerning the role of the Baldwin effect in 
the evolution of language remain unclear. 65 

We already argued, 55 that in our model the Baldwin effect is also at 
work. Let us consider a population of agents with the communication 
probability p below the threshold value (p = p c « 0.23). In such a case the 
learning ability remains at a rather low level (since clusters of agents using 
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the same language are small, it does not pay off to be good at learning the 
language of your neighbours) . Now, let us increase the value of p above 
the threshold value. More frequent communication changes the behaviour 
dramatically. Apparently, clusters of agents using the same language are 
now sufficiently large and it pays off to have a large learning ability because 
that increases the success rate and thus the survival probability p SUTV . Let us 
notice that p S urv of an agent depends on its linguistic performance u>j ) 
rather than its learning ability. Thus clusters of agents of good linguistic 
performance (learned behaviour) can be considered as niches that direct the 
evolution by favouring agents with large learning abilities, which is precisely 
the Baldwin effect. It should be noticed that linguistic interactions between 
agents (whose rate is set by the probability p) are typically much faster than 
evolutionary changes (set by p mu t) and such an effect was also observed in 
simulations. 55 

As a result of a positive feedback (large learning ability enhances com- 
munication that enlarges clusters that favours even more the increased 
learning ability) a discontinuous transition takes place both with respect to 
the success rate and learning ability . An interesting question is whether 
such a behaviour is of any relevance in the context of human evolution. It 
is obvious that development of language, which probably took place some- 
where around 10 5 years ago, was accompanied by important anatomical 
changes such as fixation of the so-called speech gene (FOXP2), descended 
larynx or enlargement of brain. 39 Linguistic and other cultural interactions 
that were already emerging in early hominid populations were certainly 
shaping the fitness landscape and that could direct the evolution of our 
ancestors via the Baldwin effect. 

The examined model is not very demanding computationally. It seems 
to be possible to consider agents talking on more than one object, 57 or to 
examine statistical properties of simulated languages such as for example, 
distributions of their lifetimes or of the number of users. It would be in- 
teresting to examine the role of topology of interaction network and place 
agents on complex networks, like e.g., scale- free networks, that are known to 
provide a more realistic description of human linguistic interactions. 19 One 
can also study diffusion of languages, the role of geographical barriers, 76 
or formation of language families. There is already an extensive literature 
documenting linguistic data as well as various computational approaches 
modelling, for example, competition between already existing natural lan- 
guages . 1 - 74 ' 94 The dynamics of the present model, that is based on an 
act of elementary communication, offers perhaps more natural description 
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of dynamics of languages than some other approaches that often use some 
kind of coarse-grained dynamics. 

1.7. Conclusions 

In the present paper we reviewed computational methods that are used for 
modelling evolutionary systems. We emphasized the need and advantages 
of using models with individual-based dynamics. We also drew attention 
to various time scales of processes that shape the evolution of complex sys- 
tems. In ecosystems these are ecological and evolutionary time scales. In 
the language evolution cultural processes set an additional timescale. Per- 
haps the most interesting phenomena arise from interactions of processes 
of various times scales. Evolutionary cycling or Baldwin effect are excellent 
examples of such phenomena, to claim however their satisfactory under- 
standing, much remains to be done. 

This mini-review is of course biased by our own experience in this field. 
We did not even mention about a number of other approaches and tech- 
niques of modelling evolutionary systems. Some of them are covered in 
other chapters of this volume. 
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